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(57) ABSTRACT 

A method and apparatus for synchronizing components 
operating isochronously that are coupled by independent 
links. The apparatus includes a synchronization circuit hav- 
ing a first and second buffer, each including an input port 
coupled to an external link, an output port, a read pointer and 
a write pointer. The read pointer indicates a next location in 
a respective buffer to be read in transferring data out on the 
output port. The write pointer indicates a next location in the 
respective buffer to be written when receiving data on the 
input port and is configured to automatically increment upon 
receipt of a first data bit on a respective external link. A 
trigger circuit is coupled to each link for receiving external 
trigger signals. Each external trigger signal is included along 
with data transmitted on the link and indicates when data is 
present on a respective link. A counter is coupled to the 
trigger circuit. The counter includes a trigger input and a 
predefined delay period. After receipt of a first of the 
external trigger signals on the trigger input, the counter is 
operable to output a read enable signal to each of the read 
pointers after the delay period has expired. 

19 Claims, 15 Drawing Sheets 
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SYNCHRONIZING SOURCE-SYNCHRONOUS 
LINKS IN A SWITCHING DEVICE 

This application is a continuation-in-part of U.S. appli- 
cation Ser. No. 08/844,171, filed Apr. 18, 1997, now U.S. 
Pat. No. 5,905,725, which is incorporated in its entirety by 
reference. 

BACKGROUND 

The present invention relates, generally to data routing 
systems, and more particularly to methods and apparatus for 
efficiently routing packets through a network. 

In packet switched communication systems, a router is a 
switching device which receives packets containing data or 
control information on one port, and based on destination 
information contained within the packet, routes the packet 
out another port to the destination (or an intermediary 
destination). 

Conventional routers perform this switching function by 
evaluating header information contained within a first data 
block in the packet in order to determine the proper output 
port for a particular packet. 

Efficient switching of packets through the router is of 
paramount concern. Referring now to FIG. 1, a conventional 
router includes a plurality of input ports 2 each including an 
input buffer (memory) 4, a switching device 6 and a plurality 
of output ports 8. 

Data packets received at an input port 2 are stored at least 
temporarily, in input buffer 4 while destination information 
associated with each packet is decoded to determine the 
appropriate switching through the switching device 6. The 
size of input buffer 4 is based in part on the speed with which 
the destination information may be decoded. If the decoding 
process takes too long as compared to the rate at which 
packets are received, large sized memory elements may be 
required or packets may be dropped. 

The transfer of data between components in an electrical 
device, such as a router, often requires some form of 
synchronization. Synchronization may be achieved by oper- 
ating devices on the same clock signal, or by providing 
clocking signals along with each data transfer. Data transfers 
between subsystems (e.g., between an input port 2 and input 
buffer 4 or between the input buffer 4 and switching device 
6) within a router may be synchronous, source synchronous, 
asynchronous or isochronous. 

Two subsystems in electrical device are characterized as 
synchronous when each makes use of a common clock 
signal, for example, to clock logic gates. To be synchronous, 
both the frequency and phase of the common clock signal at 
the respective subsystem is the same. Accordingly, where 
the clock signal is generated externally, delays in reaching 
each of the subsystems must be matched to maintain the 
phase relationship. 

Conversely, two subsystems are characterized as asyn- 
chronous when each uses independent clock signals. 

Source synchronous communications are characterized by 
the transfer of a clock signal along with a data signal when 
communicating between subsystems. The first subsystem 
operates in accordance with a first clock signal. Data passed 
between the first subsystem and a second subsystem is 
accompanied with a clock signal. The clock that accompa- 
nies the data may be the first clock signal or may be derived 
from the first clock signal. The second subsystem uses this 
clock signal to process (clock in) the received data into the 
second subsystem. 
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Two subsystems are characterized as isochronous when 
both subsystems use a clock having the same frequency but 
not necessarily the same phase. The clocks may be exter- 
nally generated (outside the respective subsystems) but are 
5 not required to be delay matched. 

The transfer of data through a router often requires the use 
of source synchronous communication links. Source syn- 
chronous communication links include clock and data sig- 
nals to allow the various components of the router to control 
10 the flow of information through the device. However, the use 
of source synchronous communication links increases the 
bandwidth required to transfer data between the compo- 
nents. 

15 SUMMARY OF THE INVENTION 

In general, in one aspect, the invention provides a syn- 
chronization circuit for synchronizing components operating 
isochronously that are coupled by independent links. The 
synchronization circuit includes a first and second buffer, 

20 each including an input port coupled to an external link, an 
output port, a read pointer and a write pointer. The read 
pointer indicates a next location in a respective buffer to be 
read in transferring data out on the output port. The write 
pointer indicates a next location in the respective buffer to be 

25 written when receiving data on the input port and is con- 
figured to automatically increment upon receipt of a first 
data bit on a respective external link. 

A trigger circuit is coupled to each link for receiving 
external trigger signals. Each external trigger signal is 

30 included along with data transmitted on the link and indi- 
cates when data is present on a respective link. 

A counter is coupled to the trigger circuit. The counter 
includes a trigger input and a predefined delay period. After 

35 receipt of a first of the external trigger signals on the trigger 
input, the counter is operable to output a read enable signal 
to each of the read pointers after the delay period has 
expired. 

Aspects of the invention include numerous features. The 
40 data transmitted over a data portion of the link is the trigger 
signal. 

In another aspect, the invention provides a method for 
synchronizing components operating isochronously that are 
coupled by independent links. The method includes provid- 

45 ing a synchronization signal from a first component to a 
plurality of second components through independent first 
links. Upon detection of the synchronization signal at a 
respective second component, an acknowledgment signal is 
returned from each of the second components to the first 

50 component through one of a like plurality of second links. 
When all the acknowledgment signals have been returned, 
the transmission of the synchronization signal from the first 
component to the plurality of second components is termi- 
nated. Upon detecting the termination of the synchronization 

55 signal at each second component, data transfer on the second 
links is initialized. 

Aspects of the invention include numerous features. The 
first component can be a switch in a router and the second 
components are input ports for receiving data from a net- 

60 work. 

Among the advantages of the invention are one or more 
of the following. Synchronization of different subsystems is 
realized without requiring a synchronous interconnect. Mul- 
tiple subsystems can be synchronized to one common sub- 
65 system. Synchronization can be achieved using in-band data 
so that no additional interconnects are required. Mutual 
synchronization between two subsystems can be realized 
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(from a first system to a second system and then from the 
second system back to the first system). Synchronization of 
multiple subsystems can be achieved out of order. A depen- 
dent synchronization of a first subsystem to a second sub- 
system can be achieved even if the synchronization of the 5 
second subsystem to the first subsystem is required to be 
performed first. 

Other advantages and features will be apparent from the 
following description and claims. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of conventional router device. 

FIG. 2a is a schematic block diagram of a data routing 
system according to the invention, is 

FIG. 2b is a schematic block diagram of a router accord- 
ing to the invention. 

FIG. 3a is a schematic block diagram of an multi-function 
port according to the invention. 

20 

FIG. 3b is a schematic block diagram indicating data 
transfers between components of the router of FIG. 2b 
according to the invention. 

FIG. 3c is a data structure for a cell transferred between 
a multi-function port and an input switch according to the ^ 
invention. 

FIG. 4 is a schematic block diagram of a router including 
the timing and ordering of transfers from the input port to 
input switch according to the invention. 

FIG. 5a is a schematic block diagram of an input switch. 30 

FIG. 5b is a schematic block diagram of an input interface 
for the input switch. 

FIG. Sc is a schematic block diagram showing the data 
links between the input switch and a multi-function multi- ^ 
port. 

FIG. Sd is a schematic block diagram of a router including 
the timing and ordering of transfers from the input port. 

FIG. 6 is a data structure for a cell transferred between the 
input switch and a memory bank according to the invention. 40 

FIG. 7 is a schematic block diagram of an output switch 
according to the invention. 

FIG. 8 is a schematic block diagram for an output section 
of a multi-function port. 

45 

FIG. 9 is a flow diagram for a process of routing a packet 
through a router according to the invention. 

DETAILED DESCRIPTION 

Referring to FIG. 2a, in a packet switching system, a 50 
source 10 is connected to one or more routers 20 for 
transmitting packets to one or more destinations 30. Each 
router includes a plurality of multi-function multiports that 
are connected to various sources and destinations. A packet 
from source 10 may pass through more than one router 20 55 
prior to arriving at its destination. 

Referring to FIG. 2b, each router 20 includes an input 
switch 100, an output switch 102, a global data buffer 104 
including one or more memory banks 105, a controller 106 
and a plurality of multi-function multiports 150 (150-0 60 
through 150-3, respectively). Associated with the controller 
106 is controller memory 109 for storing a routing table. 
Input switch 100 and output switch 102 are connected to 
each multi-function multiport 150 in router 20. In one 
embodiment, router 20 includes plug -and-p lay multi- 65 
function multiports which allows for easy expansion capa- 
bility. The present invention will be described with reference 
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to a system including sixteen multi-function multiports 150 
(even though FIG. 2b only shows four, with each multi- 
function multiport including up to sixteen input ports and 
sixteen output ports. Other configurations may be used 
depending on user load conditions. Each multi-function 
multiport includes one or more input ports, one or more 
output ports and a memory. The configuration and operation 
of the multi-function multiports will be described in greater 
detail below. 

In operation, packets are received at a multi-function 
multiport 150, transferred to input switch 100 and stored 
temporarily in global data buffer 104. When the packet is 
received by switch 100, a key is read from the first data 
block in the packet and transferred to controller 106. The key 
contains destination information which is derived from the 
header field associated with the first block of data in a packet 
and other information (such as source ID, priority data and 
flow ID). 

A route look-up engine 110 in controller 106 performs a 
tree based search based on the key information and returns 
a result which includes the output multiport associated with 
the destination. The result is coupled with other information 
(such as source ID, flow ID and packet length) for routing 
the packet through router 20 and provided as a notification 
from controller 106 to output switch 102. Output switch 102 
transfers the notification to the identified multi-function 
multiport 150. Upon receiving the notification information, 
the multi-function multiport 150 initiates the transfer of the 
packet from global data buffer 104 through output switch 
102 to the appropriate multi-function multiport 150. 

Multi-function Multiports 

Referring to FIG. 3a, each multi-function multiport 150 
includes an input section 270, an output section 280 and a 
memory section 290, 

Input section 270 includes a line input interface 300, a 
data handler 302 and an input switch interface 304. 

Output section 280 includes an output request processor 
306, a line output interface 308, a storage device 310, stream 
output buffers 312 (one for each output stream), output 
formatter 314, an output switch interface 316 and head and 
tail queue buffer 318. In addition, the output section includes 
a portion of input switch interface 304. Specifically, input 
switch interface 304 includes read request queues 305, one 
for each memory bank. The use and operation of the read 
request queues, stream output buffers, and head and tail 
queue is discussed in greater detail in commonly owned 
co-pending patent application entitled "HIGH SPEED 
SWITCHING DEVICE", filed Apr. 18, 1997, assigned Ser. 
No. 08/844,171, which is hereby expressly incorporated 
herein by reference. 

Memory section 290 includes a memory bank 105 (which 
represents a portion of the global data buffer 104) and a 
notification queue body 319. 

The multi-function multiport is used in conjunction with 
the input switch, output switch and controller as is shown in 
FIG. 3£>. The various piece components of the input section, 
output section and memory section will be described in 
greater detail below., The combination of the devices into a 
single unit simplifies the interfaces between the components. 

Referring again to FIG. 3a, packets are received at line 
input interface 300. As the packets are received, data handler 
302 divides the packets received into fixed lengths cells. In 
one embodiment, the length of each cell is 80 bytes, with 16 
bytes of internal header (control information) and 64 bytes 
of cell data. As the data handler divides the incoming 
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packets into fixed length cells, it synchronously outputs the implementation, synchronization of data transfers between 

cells to input switch 100 through input switch interface 304. the multiple multi-function multiports and the input switch 

The format for transfers between the multi-function mul- is achieved in a two step process: first a synchronization 

tiport and the input switch is shown in FIG. 3c. A cell 350 routine is performed at start-up; and, in a second step, read 

transferred from a multi-function multiport 150 to the input 5 cycles in the input switch are initiated at a fixed time after 

switch contains a cell header 352 and cell data 354. Cell a first cell has been detected from any active link. The two 

header 352 includes a type field 356, stream field 358, and step synchronization method is described in greater detail 

packet header fields 360. In addition, cell header 352 below. 

includes an independent read request in the form of a An initialization routine is required to generally synchro- 
multi-function multiport identifier 366 and address 368. io nize the outputs of the various multi-function multiports. 

The type field 356 indicates the type of cell to be initialization, each of the multi-function multiports 

transferred from the multi-function multiport. At each cell operates at the same frequency, that is, each may write one 

slot (20 clock cycles in one embodiment), a multi-function cel1 to in P ut switch 100 in one data c y cle - However the phase 

multiport may transfer either a data cell, an indirect cell of te streams received from the multi-function multiports 

placeholder, or a delayed indirect cell placeholder. The 15 vanes among the ports. More specifically, the arrival of each 

generation and operation of indirect placeholder and delayed ceU head ( the . first bit of a ^ at the in P ut wiU v . arv 

indirect placeholder is discussed in greater detail in com- for each multi-function multiport 150. The maximum time 

monly owned co-pending patent application entitled "HIGH difference of arrival for two cell heads at the input switch 

SPEED SWITCHING DEVICE", filed Apr. 18, 1997, ( that * two ^ heads associated with two cells to be read 

assigned Ser No 08/844 171 20 * n tne same data cycle by round robin data handler 500) is 

Stream field 358 indicates the stream to which the cell definc f » ( time l * la P ut ™ itch ™° 68 \ bufferin 8 

data belongs; Each multi-function multiport can process up lbi \ synchronies the reading of data from each 

to sixteen separate streams of data at a time, one on each of ^l^tion multipart. The read operation is performed at 

its respective 16 input ports. a predetermined toW after the first arnval of aceUhead 

f . . , C L, A . , , . e . 25 from any enabled multi-function multiport in a given data 

Packet header field 360 contains header information a^o- le When ig ^ {Q be tef than a sufficient 

ciated with a given packet and includes start offset ^ fa established to assure that tne head of each cell 

information, packet length and interface index information. transferred an enabled mu l ti -function multiport 150 

Multi-function multiport identifier 366 identifies the during the data cycle has in fact arrived at input switch 100. 

multi-function multiport which is sourcing the read request. 30 Input switch 10 q i nc i udes a buffer sized to hold a small 

Address 368 indicates the address in global data buffer 104 portion of each cell, up to 8 bits per line in one 

to be read. implementation, and an engine that delays the reading of 

Referring now to FIG. 4, a single cell 450 is transferred data from each multi-function multiport a set time until 

from a multi-function multiport 150 to input switch 100 at all-of the cell heads transferred from the various different 

each cell (time) slot "T". Fot a given cell slot "T", input 35 multifunction multiports have been received, 

switch 100 receives a total of "N" cells, where "N" is equal Referring now to FIG. Sb, each input interface 501 

to the number of multi-function multiports. includes an input port 430 for receiving cells from each of 

. the individual multi-function multiports 150, a buffer 432, a 

npu wi c counter 434, an input gate 436, clock circuit 438, an output 

Referring to FIGS. 2b and 5a, input switch 100 includes 40 gate 444 and detector 442. 

a round robin data handler 500, one or more input interfaces In one implementation, input gate 436 and output gate 444 

(501-0 through 501-7, one for each multi-function multiport are D-type flip flops having a data input 446, data output 448 

150), one or more memory interfaces 502 (502-0 through and clock input 450. Data input 446 of input gate 436 is 

502-7, one associated with each memory bank), a like coupled to input port 430. Data output 448 is coupled to 

plurality of pointers 504 (504-0 through 504-7), an output 45 buffer 432. Clock input 450 is coupled to an internal clock 

processor 505, one or more output interfaces 506 (506-0 source (not shown). At each clock cycle (internal clock 

through 506-7, one for each multi-function multiport 150), cycle, i.e., in the input interface domain), a single data bit is 

a reservation table 508, an indirect cell processor 510, transferred from input gate 436 to buffer 432. 

controller interface 512 and read controller 517. Buffer 432 may be of the form of a random access 

a) Transfers from the Multi-function Multiports 50 memory (RAM) or circular buffer. Buffer 432 may be 

Referring to FIGS. 4 and Sa, the transfer of cells from dedicated to receive data from a single multi-function mul- 

multi-function multiports 150 to input switch .100 present tiport or may be sized to support a plurality of multiports. In 

problems associated with synchronization and metastability. one implementation, buffer 432 is a 16x16x8 bit RAM (16 

Specifically, round robin data handler 500 within the input buffers that are 16 bits wide and 8 bits deep coupled to 16 

switch 100 can process a cell from each multi-function 55 data links for receiving data from 16 different multi-function 

multiport at each clock cycle as described above. However, multiports) for storing up to 8 data cycles of data (cell data) 

the multi-function multiports 150 and input switch 100 are from each of 16 input multifunction multiports. Associated 

isochronous with respect to each other. That is, while the with each buffer 432 are a read pointer 452 and a write 

frequency of the common clock signal used by both the pointer 454 for each link. Read pointer 452 indicates the 

multi-function multiports and the input switch is the same 60 next location in buffer 432 to be read from in transferring 

(both use the same externally generated clock signal), the data to output gate 444 for a given link. Read pointer 432 is 

phase of the clock with respect to the individual multi- incremented upon receipt of a read enable signal (RES) 

function multiports and the input switch is not the same. generated by counter 434. The operation of counter 434 is 

Accordingly, while source synchronous communication discussed in greater detail below. Write pointer 454 indicates 

links may be used between the devices, cells may arrive at 65 the next location in buffer 432 to be written to when data is 

arbitrary times at the round robin data handler requiring transferred from input gate 436, Write pointer 454 is incre- 

extra buffering at the input switch to avoid data loss. In one mented upon receipt of a write enable signal (WES) from 
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clock circuit 438. The operation of clock circuit 438 is 
discussed in greater detail below. 

Data is transferred out of buffer 432 to output gate 444. 
Data input 446 of output gate 444 is coupled to buffer 432: 
Data output 448 of output gate 444 is coupled to data bus 
456. Clock input 450 is coupled to an internal clock source 
(not shown). At each clock cycle (internal clock cycle), a 
single data bit is transferred out on data bus 456. Data bus 
456 is coupled to round-robin data handler 500 (FIG. 5a) 
and can be coupled to detector 442. Hie operation of the 
detector 442 is described in greater detail below. 

Clock circuit 438 includes screening gate 460 and may 
include one or more synchronization gates 462. Screening 
gate 460 may be of the form of an OR gate having a plurality 
of input ports and an output port. The input ports of 
screening gate 460 are coupled to input interface 501 (one 
input port is coupled to each data path in a link) and receive 
data (the same data provided to each input gate 436) from a 
multi-function multiport 150. The output of screening gate 
460 is coupled to the input of first synchronization gate 
462-1. In one implementation, two synchronization gates 
462-1 and 462-2 are provided. The synchronization gates 
may be of the form of D-style flip flops which are daisy 
chained. Each includes a clock input which is coupled to an 
internal clock source. The output (DATASEEN) of synchro- 
nization gate 462 is coupled as an input to counter 434. 

Counter 434 receives the plurality of data signals 
(DATASEEN) generated from each synchronization gate 
462 and provides as an output read enable signals (RES-x) 
to each link. The RES is used to increment the read pointers 
associated with each buffer 432 that supports an active link. 
The DATASEEN signal is active when the first bit of data is 
received from an enabled multi-function multiport. In one 
implementation, sixteen (16) separate RES signals(RES-0 
through RES-15) are generated by counter 434 so as to 
enable each respective read pointer associated with a given 
multi-function multiport data link. The RES output of 
counter 434 is activated a delay time t rfe/oy after the receipt 
of the first bit from an enabled multi-function multiport 
signaling that data may begun to be read from each buffer 
432. The amount of time delay may be adjusted by counter 
434. The time delay is measured from the receipt of the 
DATASEEN signal. In one implementation, the time delay 
t delay is calculated as the sum of t band plus time t ermrf where 
i error is an additional error component added to assure no 
overflow condition arises. The time delay t deIay is determi- 
nate in sizing buffer 432. Buffer 432 must be sized to store 
data from the first cell that arrives in a data cycle up to the 
point in time when the read enable signal is generated by 
counter 434. In one implementation, the time delay i deXay 
requires six (bits) to be stored. That is, the phase difference 
between the outputs of the respective multi-function multi- 
ports is no greater than 6 bits. In one implementation the 
number of bits stored in buffer 432 (width of the buffer) is 
eight (8) bits, even though the time delay t de i ay only requires 
six (6) bits of storage. Buffer 432 may be oversized to 
accommodate the ready commercial availability of such 
components. 

In addition, counter 434 receives as inputs a plurality of 
link enable signals (one for each multi-function multi-port 
supported by input switch 100). The link enable signals can 
be generated in software. The link enable signals indicate the 
active links (multi-function multiports) that are transferring 
cells to the input switch. Counter 434 generates a RES signal 
for each active link, enabling the transfer of data from each 
buffer 432 to a respective data bus 456. The link enable 
signals are used to inhibit counter 434 from responding to 
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spurious or otherwise erroneous signals generated by gate 
460. In the event that a link becomes stuck (the output of 
gate 460 is stuck in one position), that link may be disabled, 
the machine reset and the "data" from the link associated 
5 with the stuck gate may be disregarded. 

Synchronization 

1. Initialization 

FIG. 5c shows two multi-function multiports and their 
respective interfaces for communicating with input switch 

10 100. At start up, the individual multi-function multiports 
must be generally synchronized in order to assure that cells 
generated from each of the individual multi-function mul- 
tiports will arrive within a single i hand time period. To 
synchronize the multiple multi-function multiports, the two 

35 way communication link between the multi- function multi- 
ports 150 and input switch 100 is exploited. 

As described in detail below, communication links 
coupled between input switch 100 and each multi-function 

^ o multiport are used to transfer data to the input switch and 
receive data for storage in a memory bank 105 in the 
respective multi-function multiport. A portion of the data 
bandwidth used to transfer packets from the input switch to 
the multi-function multiport can be dedicated for the transfer 

25 of synchronization information required to synchronize the 
multi-function multiports. Alternatively, the normal data 
paths may be used and a special synchronization (or 
acknowledgment) signal may be transferred on the data 
path. 

30 Input interface 304 of each multi-function multiport is 
divided into an input section 304-i and: an output section 
304-O. Input section 304-i is configured to receive data from 
input switch 100 and output section 304-o is configured to 
transmit cells received from data handler 302 to input switch 

35 100. Each input section 304-i can be configured to include 
an interface circuit similar to input interface 501 as shown 
in FIG. Sb. 

Accordingly, input section 304-i in each multifunction 
multiport receives data from input switch 100 and includes 

40 a buffer 432 (similar to buffer 432 in FIG. Sb) for receiving 
data, various input and synchronization gates (not shown), a 
counter 434 and a detector 442. In one implementation, the 
link from input switch 100 to a multi-function multiport 
includes two or more data paths which must be synchro- 

45 nized. The synchronization of the data paths is similar to the 
synchronization of the links coupled to the input interface 
501 of input switch 100. Synchronization of plural data 
paths in a link is discussed in further detail below. 
At initialization, input switch 100 produces a initialization 

50 signal which is transferred through links 151 (151-0 and 
151-1 of FIG. 5c) to the respective input sections 304-i of 
each multi-function multiport 150. 

Detector 442 in the multi-function multiport input switch 
interface (input section 304-i) is used to detect the synchro- 

55 nization signal. Detector 442 in the multi-function multiport 
interface can be a CRC detector configured with a pre- 
defined algorithm for generating a synch detected signal 
upon detecting a particular sequence of input bits. In one 
implementation, the synchronization signal is a predefined 

60 number bits having a one ("1") value which are transferred 
during the write cycle used to transfer cells from input 
switch 100 to the respective multi-function multiports 150 in 
support of writing data to the global memory buffer. In one 
implementation, at least two consecutive l's are transferred 

65 to initialize the link. 

Data handler 302 receives data from the respective 
streams and divides the incoming packets into cells for 
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transfer to input switch 100 as described above. At 
initialization, data handler 302 provides no data output. 
When the synchronization signal is detected, data handler 
302 outputs an acknowledgment signal to input switch 100 
indicating that the synchronization signal has been detected. 
Data in the multi-function multiport is held until the termi- 
nation of the synchronization signal (as determined by 
detector 442) as described below. 

The acknowledgment signal can be an all zero's data 
stream transferred from a respective multi-function multi- 
port to the input switch. The acknowledgment signals are 
received at clock circuit 438 and input gate 436 of input 
interface 501-0 and 501-1. Each acknowledgment signal is 
transferred into buffer 432. The acknowledgment signal is 
passed out of buffer 432 through output gate 440 onto data 
bus 456 and is detected by detector 442 in the input switch 
interface. 

Detectors 442 at the input switch 100 detect the acknowl- 
edgment signal and provide an output signal which is used 
in terminating the synchronization signal. After all the of the 
links between the multi-function multiports and the input 
switch have returned the acknowledgment signal, the syn- 
chronization signal from input switch 100 to the multi- 
function multiports is terminated. 

Detectors 442 in a respective input section interface detect 
the termination of the synchronization signal and initiate the 
transfer of data cells thereafter. 

2. Synchronizing Plural Data Links (paths) 

The plural links that carry the acknowledgement signals 
from a respective multi-function multiport are synchronized 
as follows. The combination of input and output gates 436 
and 444 and buffer 432 of input interface 501 form a 
synchronous storage element (synchronous RAM) adeptly 
suited for processing phase difference data. Initially, both the 
read pointer and the write pointer associated with a given 
buffer 432 are set to the same location. When data for a first 
acknowledgment signal is received, the write pointer of 
buffer 432 is incremented on each data cycle as data is 
received. As the write pointer is incremented, buffer 432 is 
loaded with data. The receipt of data on a link triggers the 
generation of a DATASEEN signal which is provided as an 
input to counter 434. After the appropriate time delay, the 
read pointer for each active link is incremented indicating 
that the time period for receipt of a cell header for a given 
data cycle has closed and that data may begin to be read by 
round robin data handler 500. Round robin data handler 
reads data provided on data bus 456. After the read pointer 
is enabled, the read pointer is incremented at the same rate 
as the write pointer, avoiding any data overflow condition in 
buffer 432. The DATASEEN signal and counter is only 
active during the first data cycle. Thereafter, the read and 
write pointers are continuously incremented in support of 
data cells received from the respective multi-function mul- 
tiports. 

Synchronization between multi-function multiports and 
the input switch has been described above. Other portions of 
the router may require application of similar synchronization 
techniques. For example, the link between the multi- 
function multiports and the output switch is similarly con- 
figured. In order to assure that a cell is received at the output 
switch from each multi-function multiport in a given clock 
cycle, synchronization of the link is required. Again, each of 
the interfaces that receive plural data path connections is 
configured with a buffer, logic gates, and a detector for 
allowing the synchronization of the plural data paths. 

In one implementation, the link between input switch 100 
and each multi-function multiport includes a plurality of 
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data paths for transferring data. Data paths can be synchro- 
nized as described above by incorporating the input interface 
circuit described in association with FIG. Sb into the receive 
portion of each path. 
5 The transfer of data on other links between the sub- 
systems of the router is described in greater detail below. 

b) Transfers through the Input Switch 

Referring again to FIG. 5a, round robin data handler 500 
receives cells from each multi-function multiport and trans- 
it) fers them to output processor 505 for output to an appro- 
priate memory bank 105 in global data area 105 (FIG. 3a). 
Round robin data handler 500 services the inputs (cells) 
received on input interfaces 501 via data bus 456 in a round 
robin, time division multiplexed manner. That is, for a given 

15 cell slot, one cell from each multi-function multiport is 
received at the round robin data handler 500 and subse- 
quently transferred to output processor 505 for transfer at the 
next cell slot to a memory bank 105 in global data buffer 
104. At the next time cell slot, data handler 500 transfers the 

20 next cell received from the same multi-function multiport to 
output processor 505 for transfer to a different memory 
bank. In one embodiment, the next cell received is trans- 
ferred to the next memory bank (next in numerical order, 
modulo N) in the memory array. Alternatively, another time 

25 dependent permutation may be used to control the transfer of 
successive cells from the same multi-function multiport. 

Referring to FIG. 5d, the timing and ordering of transfers 
from the multi-function multiport to memory is shown. For 
the purposes of this example, a sequence of cells is depicted 

30 on each transmission line. For the purposes of this example 
only, each transmission line is considered to be very long 
and contains data associated with two or more cells. In 
operation, the transmission lines are short and multiple cells 
are not present on a transmission line at a given time. At cell 

35 slot T4 a series of cells 450-0 through 450-7 are transferred 
down transmission lines 458, one from each multi-function 
multiport 150 to input switch 100. At cell slot T3 (one just 
prior in time to cell slot T4) a series of cells 452-0 through 
452-7 are transferred down transmission lines 458, one from 

40 each multi-function multiport 150 to input switch 100. 

Round robin data handler 500 and output processor 505 
within the input switch 100 transfer cells out to global data 
buffer 104 on transmission lines 460. As can be seen at cell 
slot T2, output processor 505 outputs one cell 454-B 0 to 

45 454-B 7 to each memory bank in a single cell slot. The "B/' 
designator indicates the multi-function multiport from 
which the particular cell was received. One cell from each 
multifunction multiport is written to global data buffer 104 
per cell slot. At time period Tl (one cell slot prior to cell slot 

50 T2), again one cell (456-B 0 to 456-B 7 ) is written to each 
memory bank. Round robin data handler 500 time division 
multiplexes the transfers to output processor 505 such that 
consecutive cells from the same multi-function multiport are 
written to consecutive memory banks 105 (modulo N) in 

55 global data buffer 104. 

Referring again to FIG. 5a, pointer 504 indicates the 
location in an associated memory bank to which the next cell 
will be written. Output processor 505 writes a cell to a 
memory location in a particular memory bank based on the 

60 next available address in the bank as is indicated by the 
associated pointer 504. 

c) Key Reading and the Linking Process 

Round robin data handler 500 includes a key reading 
engine 514 for determining the key information associated 
65 with a first cell in a packet and a linking engine 515 for 
linking cells in the same packet. The linking of cells through 
output switch 102 is described in greater detail in commonly 
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owned co-pending patent application entitled "HIGH requests reflect a request for cell data to be transferred from 

SPEED SWITCHING DEVICE", filed Apr. 18, 1997, a memory bank 105 to output switch 102 for ultimate 

assigned Ser. No. 08/844,171. transfer to a requesting multi-function multiport 150. 

d) Transfers to Memory ^ memory in the m ulti-function multiport configuration 

? structure of a 0611 lransferred f^m input switch 5 physically distributed across a number of banks b, one 

100 (via the output processor 505) to a memory bank 105 in bank for each active multi-function multiport in the system, 

global data buffer 104 is shown in FIG. 6. The unit of A) Transfers from the Input Switch to Memory 

addressing and memory allocation is a 64-byte cell, and all Referring again to FIG. 5c, the transfer of cells from the 

accesses to memory are either cell reads or cell writes. A cell inpilt swit ch 100 to global data buffer 104 is performed in a 

size of 64 bytes was chosen as a compromise between the 10 ti me division multiplex fashion. That is, consecutive cells 

conflicting requirements of bandwidth efficiency and storage &om a given multiport are directed to different memory 

efficiency. DRAM bandwidth efficiency dictates larger sizes, destination locations. At each time period (cell slot), the 

while storage loss caused by internal fragmentation when in pil t switch transfers to memory a single cell received from 

fitting variable size packets into fixed size cells dictates each multi-function multiport (as available) into memory. At 

smaller sizes 15 a next time T+l the input switch transfers again a single cell 

^ e L a ^ . ° UtpU ! P rocessor 505 grates a cell kom each mmpori ^ memory . Successive entries from 

800 which includes a read request source field 802, read the same input multiport are written to different memory 

address 804, write address 806 and data field (cell data Danks 10 5 i n global data buffer 104. 
received from multiport 150) 808. The read request source 

field 802 indicates the output port (in the particular multi- 20 Controller 

function multipart 150) requesting the read (destination n £ . n ^ 

output port). Output processor 505 receives read requests Referring again to FIG. 2b, controller 106 includes con- 

from read controller 517 and bundles the read request with trollcr mcmor y 109 > route look-up engine 110, an input 

any write request received from round robin data handler switch mterface > and 0Ul P ut swilch interface. Controller 106 

500 destined for the same memory bank. At each cell slot, 25 rcccivcs a r ? ute lo ? k " u P rcc l uest from in P ut switch 100 at thc 

output processor 505 provides a cell 800 which may include ^ swl . tch lI * erface - Route ^k-up and the matching of 

a write and read request to each memory bank 105 in global ke y s retnevcd from a P ackct order to determine a best 

data buffer 104. match route through the router is described in greater detail 

Read controller 517 controls the transfer of read request m «>-pending Patent application entitled "HIGH SPEED 

signals flowing from input switch 100 out memory interface 30 Y^I^^^™ B ^ T MAFCH L00KUP IN A 

502 to the inmvidual memory banks in global data buffer SWITCHING DEVICE", filed on Dec. 16, 1996, by Fer- 

104. Read controller 517 receives read requests from each S" 8011 et ah > Ser * No * ^^1^16, which is hereby expressly 

multi-function multiport through output interfaces 506. The incorporated herein by reference. 

format of each request includes source identification (output ^ route look-up engine servicing the route look-up 

port) and a full address in memory which is to be read. At 35 request performs a best match look-up and outputs a noti- 

each cell slot, each multifunction multiport port may gen- fication through output switch interface to output switch 

erate a read request for processing by switch 100 to read a 102 • Tne notification includes a result which indicates the 

memory location in global data buffer 104, resulting in the multi-function multiport to be used in the transfer of the 

reading of a cell (a read reply) from a memory bank 105 (on packet to its destination, 

a subsequent cell slot) to output switch 102. 40 . 

Read controller 517 loads a reservation table 508 as ° utput Switch 

requests to transfer packets are received from the various Referring now to FIG. 7, output switch 102 includes a 

multi-function multiports 150. The architecture and routing controller interface 1500, one or more memory inputs 1502 

of read requests is described in greater detail in co-pending (1502-0 through 1502-7, one for each memory bank), one or 

patent application entitled "HIGH SPEED SWITCHING 45 more outputs 1504 (1504-0 through 1504-7, one for each 

DEVICE", filed Apr. 18, 1997, assigned Ser. No, 08/844, multi-function multiport), a result processor 1506 and an 

171. output processor 1508. Output switch 102 performs four 

Memory Architecture functions; receive output results, process output results, 

receive cells from memory and output cells to output ports. 

Main memory is used as temporary buffer storage for 50 a) Transfers from Memory to the Output Switch 
packets flowing into the system on input streams and out of Cells from memory are received at memory inputs 1502 
the system on output streams. Main memory is divided into and transferred to output processor 1508. As described 
two distinct parts: a global data buffer that is used to store above, in order to synchronize the transfer of data from 
incoming packets while the lookup engine determines the distributed memory devices (multi-function multiports) to 
outgoing stream for each packet; and packet notification 55 the output switch, an interface configured as shown in FIG. 
queues that are used to store packet pointers (notifications) 56 may be included in the output switch. Cells are trans- 
after the outgoing stream has been determined. Notification ferred based on read requests received at the input switch 
queues are associated with outgoing streams, whereas the fr 0rn multi-function multiports. 

global data buffer forms a common pool shared amongst all Output processor 1508 decodes the destination multi- 

the streams. 60 function multiport from cell information received from 

The global data buffer includes a plurality of memory memory and transfers the cell data to the appropriate outputs 

banks. Associated with each memory bank is an input switch 1504. At each cell slot, output switch 102 may receive a cell 

interface (an input port) 304 and output switch interface (an for processing from each bank in global data buffer 104. 

output port) 316. At each cell slot, each memory bank b) Transfers from the Output Switch to the Multi-function 

receives at most one write and one read request via input 65 Multiports 

switch interface 304. The write requests are associated with Output switch 102 receives notification from controller 

cells received from a multi-function multiport 150. Read 106 on controller interface 1500. Result processor 1506 
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decodes the result (route) and determines which multi- Initialization 
function multiport(s) 150 is (are) to receive the route data. Synchronization is achieved in the router in two phases. 
Based on a mask m the notification, result processor 1506 M initialization phase is triggered at power up. The initial- 
transfers the notification to output processor 1508 for trans- ization phase is used to synchronize the major components 
fer to each multi-function multiport 150 indicated. At each 5 that operate isochronously with respect to each other. In a 
cell slot, output processor 1508 provides (via outputs 1504) second phase, components within the router are kept in 
a route to each multi-function multiport 150. synchronization after the initialization phase by using a 

common clock, source synchronous links and interface 

Output Section of a Multi-function Multiport circuitry as described above. 
r» r . 4 0 , ... „ it ,10 At initialization, the sequence of synchronization is 

Referring now to FIG. 8 each multi-funcUon multiport ordered for the respective Hr^ in the router. Referring again 

150 includes ;an output switch interface 316, an input switch t0 mGr 2a , in one implementation, the controller 106 to 

interface 304 including read request queues 305, head and mput switc h 100 ^ and controlle r 106 to output switch 

tail queue buffer 318, an output request processor 306, an 102 links are the first links synchronized. The links coupling 

line output interface 308, storage device (memory) 310, Jfi mput switch 100 to each multi-function multiport 150 are 

stream output buffers 312 and output formatter 314. initialized next. The initialization includes generating a 

The architecture the output section of a multi-function synchronization signal for transfer to each of the respective 

multiport and the routing of cells through the output section multi-function multiports 150. Thereafter, the links between 

is described in greater detail in co-pending patent applica- the multi-function multiports 150 and input switch 100 are 

tion entitled "HIGH SPEED SWITCHING DEVICE", filed m mitializcd including the transfer of acknowledgment signals 
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from each of the active links. 
After receipt of all the acknowledgment signals, the links 

Packet Routing Overview coupling input switch 100 and each multi-function multiport 

150 are synchronized. The synchronization signal transmit- 

Referring now to FIG. 9, in a method of routing packets ted by the input switch is terminated. At the same time, the 

through a switch, a packet is received at a multi-function links between input switch 100 and controller 106 are 

multipart (1800). The multi-function multiport divides the synchronized. 

packet into fixed length cells and transfers the cells to an ^ between the multi-function multiports 150 and 

input switch (1802). Input switch removes the key informa- outpm switch 102 are synchronized next. Thereafter, the 

tion from the first cell in a packet and stores it temporarily respective multi-function multiports 150 are enabled to 

in a key buffer (1804). Thereafter the input switch routes the 30 transmit data resulting in the synchronization of the links 

cells to memory banks resident in the multi-function mul- between the multi-function multiports 150 and input switch 

tiports in a time division multiplexed manner (1806). The 10 o. Finally the links between output switch 102 and the 

input switch stores the first address in memory where the multi-function multiports 150 and between output switch 

first cell is stored and computes offsets for each additional 102 and controller 106 are synchronized, 

cell associated with the offset in memory for the next ^ present jetton has been described in terms of 

^ mCm ° ry bank ^ nt0 whlch thc next cel1 is wri" 00 specific embodiments, which are illustrative of the invention 

(1808). The mput switch creates indirect cells to store and not t0 be construed as Umixillgt 0 ther embodiments are 

linking information for the packet if the packet length within me of thc fo n owing dainis . 

exceeds five cells (1810). If the number of cells exceeds the Wnat ^ d^med i s - 

number of available oflsets in an indirect cell, then the old 40 L A synchronization circuit for synchronizing compo- 

indirect cell is stored in memory and a new indirect cell is mQ{s operating isochronously that are coupled by a plurality 

created and loaded based on the offsets calculated for each of 

independent links, comprising: 

new cell received at the mput switch. fi _. j j u » u • 1 j- • 

y a first and second buffer, each including an input port 

When the packet (and its indirect cells if any) have been 45 coupled to an external link of the plurality of indepen- 

stored in memory, then the key, full address of the first cell dent links, an output port, a read pointer and a write 

and offset information is transferred as a lookup request to pointer, the read pointer indicating a next location in a 

a controller (1814). The controller performs a best match respective buffer to be read in transferring data out on 

look-up and generates a result of the look-up. The result the output port, the write pointer indicating a next 

includes the destination port (multi-function multiport), 50 location in the respective buffer to be written when 

address, offset information and next hop index (1816). A receiving data on the input port and configured to 

notification including the result is transferred to the output automatically increment upon receipt of a first data bit 

switch for transfer to the appropriate multi-function multi- on a respective external link; 

port (1818). a trigger circuit coupled to each link of the plurality of 

Upon receipt of a notification, the multi-function multi- 55 independent links for receiving external trigger signals, 

port generates read requests a cell at a time to the input each external trigger signal included along with data 

switch for the data associated with the packet (1820). The transmitted on a respective link and indicating when 

input switch issues the read requests in a time division data is present on the respective link; and 

multiplexed fashion generating a single request to each a counter coupled to the trigger circuit, the counter 

memory bank per cell slot (1822). When the memory bank 60 including a trigger input and a predefined delay period, 

receives the request from the input switch, cell data and a only after receipt of a first of the external trigger signals 

multi-function multiport identifier associated with the on the trigger input the counter being operable to output 

request are transferred to the output switch (1824). Again, at a read enable signal to each of the read pointers after 

each cell slot, the output switch transfers a single cell to each the delay period has expired. 

of the multi-function multiports. Upon receipt, the multi- 65 2. The synchronization circuit of claim 1 where data 

function multiport couples the cell data with a media header transmitted over a data portion of the link is the trigger 

and streams the data to a destination (1826). signal. 
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3. A method for synchronizing components operating 
isochronously that are coupled by independent links com- 
prising: 

providing a synchronization signal from a first component 
to a plurality of second components through indepen- 
dent first links; 

upon detection of the synchronization signal at a respec- 
tive second component, returning an acknowledgment 
signal from each of the second components to the first 
component through one of a like plurality of second 
links; 

when all the acknowledgment signals have been returned, 
terminating the transmission of the synchronization 
signal from the first component to the plurality of 
second components; 

upon detecting the termination of the synchronization 
signal at each second component, initializing data 
transfer on the second links. 

4. The method of claim 3 where first component is a 
switch in a router and second components are input ports for 
receiving data from a network. 

5. A method of synchronizing a plurality of components, 
comprising: 

transmitting an initialization signal to each of the plurality 
of components via a corresponding plurality of inde- 
pendent links; 

receiving acknowledgment signals from respective ones 
of the plurality of components; and 

concurrently terminating transmission of the initialization 
signals to the plurality of components in response to 
receiving a last one of the acknowledgement signals. 

6. The method of claim 5, wherein the plurality of 
components comprise circuits for processing data packets. 

7. The method of claim 5, further comprising: 

after terminating transmission of the initialization signals, 
receiving packets from one or more of the plurality of 
components. 

8. The method of claim 7, wherein the packets comprise 
data packets, control packets, or cells. 

9. The method of claim 7, further comprising: 

for each component from which packets are received, 
writing the packets in a buffer at a location identified by 
a write pointer. 

10. The method of claim 9, further comprising: 

for each component from which packets are received, 
reading the packets from the buffer at a location iden- 
tified by a read pointer. 
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11. The method of claim 10, wherein the reading step is 
performed a predetermined time after a first packet is written 
into the buffer. 

12. The method of claim 10, further comprising: 
outputting the read data packets to a data handler. 

13. A circuit for synchronizing a plurality of components, 
comprising: 

first logic configured to transmit an initialization signal to 
each of the plurality of components; 

second logic configured to receive acknowledgement sig- 
nals from respective ones of the plurality of compo- 
nents; 

third logic configured to terminate transmission of the 
initialization signals to the plurality of components in 
response to receiving a last one of the acknowledge- 
ment signals; 

a buffer for storing received packets after transmission of 
the initialization signals is terminated; 

a trigger circuit for generating a trigger signal when a first 
packet is received; and 

read logic for reading packets from the buffer a predeter- 
mined time after the trigger signal is generated. 

14. The circuit of claim 13, wherein the predetermined 
time is greater than a maximum time difference of arrival for 
two packets. 

15. A circuit for synchronizing the transfer of packets 
from a plurality of components, comprising: 

a memory for storing packets transferred from the plu- 
rality of components; 

a trigger circuit for generating a trigger signal only when 
a first packet of the packets from the plurality of 
components is received; and 

read logic for reading packets from the memory a prede- 
termined time after the trigger signal is generated. 

16. The circuit of claim 15, wherein the predetermined 
time is greater than a maximum time difference of arrival for 
two packets. 

17. The circuit of claim 15, wherein the read logic 
comprises a counter for updating a read pointer in the 
memory a predetermined time after the trigger signal is 
generated. 

18. The circuit of claim 15, wherein the packets comprise 
data packets, control packets, or cells. 

19. The circuit of claim 15, wherein the memory com- 
prises a buffer for each respective component. 
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